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ABSTEACT 

As part of a study of the basic sJcills of secondary 
level education students, a study of prospective teachers' reading 
ability vas conducted at Pennsylvania state Oniversjity. Subjects were 
47 students in secondary education. Tvc separate assessments of 
reading vere used, the Selson-Denny Eeading Te^t and a criterion 
referenced test cf reading based on an article in a professjional 
journal. Eesults indicated that scores on the t«o tests correlated 
significantly only between the vocabulary section of each test and 
the total scores. Eesults also indicated that on the Selson-Denny 
test the students' average score was close to the sixtieth percentile 
and on the criterion referenced test the students* average score was 
just over B21E correct, tthile female students performed better on the 
Nelson*Denny test, no differences by sex were fcund on the 
criterion-referenced test, when the results were examined according 
to students* subject area, prospective science teachers scored 
highest, followed closely by English majors, Kath majors scored 
lowest on the reading tests, (HKfi) 
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The Penn State Secondary Faculty was most concerned about prospective 
teachers' reading ability* Our concern is that we have no University-wide 
assessment of reading^ hence no data on these students* reading levels* 
As a result, we included two separate assessments of reading: the Nelson- 
Denny Reading Test> a widely-used standardized test for adults^ and a 
cri terion^referenced test of reading^ developed by Sandra L. Snyder (research 
assistant) and me* 

The Nelson-Denny was chosen because it has demonstrated validity and 
reliability (*95 at the college level) > and it is easy to administer and 
score. We used the short version^ which allows 10 minutes for the vocabu- 
lary section and 20 minutes for the comprehension section* The Nelson- 
Denny> Form D> was administered in groups to students in the generic methods 
c!ass> including students in Engl ish/cotnmunicatton> math> science^ and 
social studies* From the Nelson-Denny> three scores are generated: Vocabu- 
lary> Conprehens ion » and Total* The Total score is figured from the raw 
scores according to the formula^ j = V 2C* 

The Criterion-referenced Test (CRT) was developed as a test of professional 
reading skill. Whereas rhe Nelson-Denny used passages on general topics 
for its comprehension assessment^ the criterion-referenced test is based on 
the reading of an article in a professional journal, "What's New in Ability 
Grouping?'^ (B* J* Wilson and D* W* Schmits) from the Phi Delta Kappan * 
The rationale for such a professional reading source is that a teacher 
should be assessed on reading material similar to that which s/he will be 
reading as part of his/her continuing professional development* The Kappan 
is recognised as a respected and well-wriLten journal of general interest 
to teachers . 
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The criterion-referenced test establishes four objectives to be 
measured : 

Given the professional reading selection, the prospective teacher 
wi 1 1 demonstrate: 

1* understanding of professional vocabulary used in the reading; 

2. ability to answer literal level comprehension questions (known 
as low comprehension); 

3. ability to answer inferential level comprehension questions 
(known as high comprehension); 

4. ability to interpret information found in tables. 

Thus, the test has four sections and we derive five scores from it: 
K Vocabulary — 6 items 

2* Low Comprehension " 5 items 
3* High Comprehension -^^^^ S items 
4* Data Interpretation 3 items 
5* Total — 23 items 

Comprehension Levels here are defined as in Barrett's Taxonomy of 
Reading Comprehension (Barrett, 1372)^ The four levels given by Barrett 
correspond roughly to Bloom's Taxonomy of Cognitive Levels (Bloom, 1956) 
for Levels I, 2, and 3 (see Figure 2), wbite Level 4, appreciation, belongs 
in the Affective Domain* The CRT in reading tests only Levels I and 2 of 
Barrett's Taxonomy. Levei 3* Evaluation, is tested by the writing sample, 
to be described in a later paper. For the writing sample, students were 
asked to respond in writing to one of two Level 3 questions related to the 
$ame reading selection. 

Insert Figure 2 About Here 

This organization for assessing reading is based on the need for 
readers to move up the taxonomic levels as they read and consider a passage* 
Thus, our assessment procedure asks the prospective teacher to (I) read the 
article; (2) complete the CRT on reading; (3) complete the writing sample. 




2 Inferential 



1 Literal 



Figure 2 



Barrett's Levels of Comprehension Related 
to the Taxonomy of Cognitive Levels. 
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The entire assessment can be completed by most students in a 75 minute 
period, although the test is not timed. Students are allowed to use as much 
time as "necessary to complete the assessment. In addition, the CRT is 
given in our Instructional Support Center, an independent learning center, 
at which the student makes an appointment at his convenience to take the 
assessment . 

These two assessments of reading clearly have several differences: ' 

criterion-referenced vs, norm-referenced 

not t imed vs . t imed 

individual scheduling vs. group testing 

professional material vs- general material 

The questions we are concerned with here, then, include: 

L Are these tests providing us with the same information? 

2< How do these prospective secondary teachers fare in reading, by 
content area and by sex? 

The correlations between the Nelson-Denny and the CRT are our best 

evidence on question K We would predict high correlations between the 

two tests and their comparable sections. However, the only significant 

correlations were between the vocabulary sections of each test and the total 

scores. This suggests that vocabulary is tested similarly in both tests, 

perhaps also contributing to the significant total score correlations. The 

comprehension scores do not show high correlations with one another or the 

other sections of the tests. Nor does Oata Interpretation, table reading, 

correlate highly. It seems reasonable to conclude that there are some 

elements of reading treasured in both tests, but there Is a large area of 

assessment which Is not the same. The tests are not measuring the same 

things entirely. 
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The difference in measurement is especially important to the faculty 
who believe that comprehension is a major goal of professional reading* Our 
analysis of the comprehension secton of the Nelson-Denny is that while it 
contains both Level 1 and Level 2 questions^ it does not contain as heavy 
an emphasis on inferential (Level 2) comprehension as does the CRT. 

The second major question asks how well our prospective secondary 
teachers do in reading. Looking at the whole group of students^ the 
means on the two tests look 1i!:e this: 

Nelson'^Dftnny Criterion-Referenced Test 

(mean percentiles) Mean Possible 

Vocabulary 57*2 Vocabulary 5*09 6 

Comprehension 5B*5 Low Comprehension 4.07 5 

Total 59*0 High Comprehension 7*65 9 

Data Interpretation 2.11 3 

Total 18.91 23 

Both sets of results are encouraging* On the nornr referenced Nelson^Denny> 
our students' average score is close to the 6Qth percentile. On the CRT> 
our students' average score is just over 82 percent right* These figures are 
encouraging, given the bad press teachers have been given. Further research 
on practicing teachers and including additional variables will be needed 
before more definitive answers can be found. 

The sex question is part of our evaluation here because it has become 
traditional to expect females to do better than males on reading tests* 
Again, our results show differences between tKe tests* True to the predic- 
tJOns» the norm-referenced Nelson-Denny shows significant differences 
between the sexes in vocabulary and in the total score. The comprehension 
difference approaches significance; 



ERLC 



Ne)son*Oenny Reading Test 
(mean percentiles) 



Vocabu )ary 



Comprehens ion 



Total 



Male 



52 J 



51-2 



Fema 1 e 



64.6 



64,6 



66.5 



-On the CRT> on the other hand> no differences by sex were found on any 
of the five variables. None eve approached significance. If the standard 
norm^referencecl test is biased against males^ then the CRT does not reflect 
that bias. 

When we examine these reading results by subject area> similar mixed 
results are found. We compared four groups: Engl ish/convnunication^ matht 
science^ and social studies. On the Nelson-Denny^ none of the three variables 
showed significant differences by subject area. On the CRT> only two of the 
five variables showed sic)nificant differences. It is striking that vocabu* 
lary» which correlates well between tests^ does not identify differences. 
Inbtcacl> ihe High Comprehension (Level 2) section and the Total score show 
differences at high levels of significance. Science teachers scored highest^ 
followed closely by English teachers. Math teachers scored lowest> with social 
studies teachers slightly above them. Th^i significance in the differences 
is between the scores of science and math teachers. This suggests that 
these are meaningful differe.ices. We will be watching to 5^ee if this 
pattern ts found in subsequent testing cycles. The low standing of the math 
and social studies teachers^ compared to the English and science teachers 
may be related to the^ small N's. However^ it ray also suggest the way they 
have been trained to respond by their disciplines. In the CRT > the ability 
to operate at a higher level of comprehension is weighted heavily in the 
total score (9 of 23) . 
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Me were saiiewhat surprised, in retrospect, that English teachers didn't 
score exceptionally well on both tests. Somehow we assumed that all the 
reading in English classes would prepare them better to handle reading tasks- 
While these English teachers read weli enough, they are not at the top on 
the CRT. 

We conclude, then, that the reading levels of prospective teachers in 
the ?enn State secondary program is reasonably high. We can feel reasonably 
^ure that these teachers can read professional materials successfully. While 
the English teachers' scores are higher than some of the other subject 
groups, the differences are smaller than expected* Although further research 
needs to be conducted with larger N*s and including additional variables, 
these preljminar> results support our belief that the reading sicills of our 
prospective teachers can withstand public scrutiny. 

In addition, the assessment procedures demonstrate the value of multi- 
ple tests of the same sicill area. We gain valuable information about our 
students' reading sicills from both tests. We can provide Information to 
our slceptical public which they can understand, and we can provide precise 
diagnosis of reading difficulties to prescribe remedial teaching for our 
wealcer students. 
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